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A new approach to time-domain pulse shaping in digital sampled sys- 
tems is described. The proposed method allows time-limited impulse re- 
sponses with optimum specified energy distribution in the frequency 
domain to be generated. Additional constraints to guarantee zero inter- 
symbol interference are easily taken into account. Nyquist-type pulses 
which have the maximum possible amount of their total energy concen- 
trated below some given frequency are one particularly important applica- 
tion. An example of such an impulse response with only 6 percent excess 
bandwidth is presented which shows that 99.96 percent of the energy can be 
concentrated in the desired bandwidth with a pulse 16 baud intervals long 
that can be generated using a read-only memory (ROM) with only 256 
bits of storage. This new class of signals can be used advantageously for 
waveform generation and processing in digital data systems. 

I. INTRODUCTION 

The joint optimization of functions in both time and frequency do- 
main is a classical problem in communication theory. Hilberg and 
Rothe 1 have recently found the lowest possible product of pulse and 
one-sided spectral widths and have numerically evaluated the impulse 
and frequency response-which is not Gaussian-that corresponds to this 
minimum. Landau, Pollak, and Slepian 2-4 in their classical papers have 
derived the pulse-form of given duration that has a maximum of its 
energy concentrated below a certain frequency and vice versa; the 
solutions to this problem are given by the now well-known prolate 
spheroidal wave functions. Additional comments on this problem have 
recently been given by Hilberg. 5 A widespread opinion is that pulses 
with minimum energy at high frequencies should have a rounded form 
with many continuous derivatives. This is not true; in fact, the optimum 
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pulses based on the prolate spheroidal wave functions are usually not 
continuous at the limits of their truncation interval. Hilberg 6 has shown 
that constraints of continuous derivatives tend to increase substantially 
the total out-of-band energy. 

Steep spectral roll-off above the Nyquist frequency and small 
residual out-of-band energy are desirable properties for signals in data 
transmission systems to achieve maximum signaling rate over band- 
limited channels and to avoid fold-over distortion in modulation and 
demodulation. We have here, however, a very important additional 
constraint: The generated signal must also have negligible intersymbol 
interference. One method of deriving shaping niters which simultane- 
ously minimize intersymbol interference and stopband response was 
proposed by Spaulding. 7 His procedure generates better results than 
the traditional approach of approximation to the raised cosine roll-off 
in the frequency domain only. 

In this paper we will again carry out optimization in the frequency 
domain only; but we constrain the intersymbol interference to be ex- 
actly zero and we truncate the pulse duration to a chosen number of 
baud intervals. The impulse response is represented in sampled form. 
This new class of signals will have particular application in digital 
modem design. 

II. THE SAMPLED APPROACH 

A sampled Nyquist-type impulse response with samples a, is shown 
in Fig. 1 . For convenience, we will assume even symmetry, an integral 
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Fig. 1 — Impulse response given by samples a*. Truncation at t = ±M T; sample 
spacing At = T/n. 
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number m of samples per baud interval, and coincidence of every ,uth 
sample with the zero crossings; thus 

a ±k „ = for k = ±1, ±2, • • • , ±M) 

o, = a_, I- (1) 

a, = for |t| ^ M M J 

The resulting spectrum is 

S(w) = W(a>) £ aie-W" (2) 

where W(a>) is an associated weighting function which may take into 
account the conversion from impulses to a staircase waveform or any 
other form of interpolation network. Let us define the (2/jM + 1)- 
sample vector 

a r = (a-pM, ■ ■ • , a , • ■ • , a„. v ) (3) 

and the transformation vector 

p r = \p { \, with pi = 8-W, (4) 

so that we can write the spectrum in the simple form 

S(o>) = TF(u)a r p. (5) 

The power density spectrum is given by* 

|*S(«)| a = | W(w) | 2 a r pp + a. (6) 

If we assume that the function w(t) has energy E w and is nonoverlap- 
ping (width ^ T/n), the total energy i?(oo) is simply 

tf(co) = a r a£„.. (7) 

The energy below a>o is of course 

E(m) = ^~ T" \ W(u) | 2 a r pp f a rfo>. (8) 

6irJ- U0 

Our goal is again to find a, so that 

A = BfSo = max (9) 

or, by combining the last three equations, 

Xa r a = & T Ra (10) 

where the elements of the symmetric matrix R are defined by 

ra = -4- f ° I F(«) I 2 cos (c.7 1 *— ) dcd (11) 

and a has to satisfy the constraints (1). This constraint reduces the 
* A dagger is used to indicate the conjugate transpose, a f = a* r . 
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degree of the quadratic form (10), since o M * = 5o* and thus all terms 
*V»,n* are immaterial. After elimination of the zero elements and con- 
centration of the remaining elements, the new form 

\a r a = k T Rk (12) 

evolves, which is now free of constraints. The desired solution is then 
simply given by the eigenvector of R which corresponds to the largest 
eigenvalue \ mttX (since no other choice of d will give a larger X). The 
original vector a can easily be obtained by inserting zeros in the correct 
positions of a. 

The elements r« in (11) will of course depend on the choice of o> and 
numerical integration generally will be necessary to evaluate them. 
Because of the Toeplitz and symmetric nature of R, only a small num- 
ber of terms need really be calculated. Numerical integration and de- 
termination of eigenvectors are available as subroutines with most 
computers, so that no complex programs need be written for the pro- 
posed optimization method. We also would like to emphasize that the 
described method is very flexible. One might, for example, try to mini- 
mize the energy contribution within some given frequency range 
coi < a) < w 2 ; this may easily be achieved by changing the integration 
limits in (11). 

Two cases of W(a>) are of practical interest. The first one is the zero- 
order-hold function which generates a staircase waveform (this is the 
usual output of D/A converters). In this case, we have* 



and therefore 



W(o) =^sinc(^) (13) 

where we have expressed co in terms of the normalized Nyquist excess 
bandwidth /3. 

In the second case we will assume w(t) = 8(t), so that the spectrum 
W(<a) is flat. Due to the periodicity of the resulting spectrum, it is rea- 
sonable to consider the energy distribution within one period only. The 
resulting elements of the matrix R can then be expressed in closed form 



Uh ■■ — — sine tt(1 + 0) - 
m L 



r« = 



1 + g ,. ,-, , oS [i ~ k 

1 + 



if i ^ k 



if i = k 



which further simplifies the optimization procedure. 
* We define sine (a-) = sin {x)/x for convenience. 
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III. GENERALIZATION FOR ARBITRARY SPECTRAL BANDS 

Equation (10) is a special case of the more general problem of maxi- 
mizing the energy in one or more specified frequency bands with re- 
spect to the energy in some other frequency bands. Taking into ac- 
count the desired integrating limits and the constraints (1), a quadratic 
form 

Xk T Qa. = k T m (10) 

will then evolve, containing (12) as a special case with Q — I. By sub- 
stituting 

b = VQa, (17) 

we have now to deal with the new form 

Xb r b = b^Q-'RylQ-'b, (18) 

which is identical to (12). We are looking for the particular b satisfying 

VQ-^Q-^ = Xb. (19) 

By premultiplying both sides with V() _1 , we get 

Q-iRk = Xa, (20) 

so that the desired a is simply the eigenvector of Q~ 1 R which corre- 
sponds to the largest eigenvalue X max .* The matrix Q is guaranteed to 
be nonsingular since it is not possible to have zero energy in a finite 
frequency interval with a time-truncated impulse response. 

IV. EXAMPLE 

To get some feeling for the capabilities of the described optimization 
procedure, the samples of a Nyquist-type impulse response were calcu- 
lated using the following parameters: 

Excess bandwidth factor /3 = 0.06 
Truncation for \t\ > 8T (M = 8) 
n = 4 samples per baud interval. 

The unusually tight roll-off would allow full 4800-baud operation over 
voice-grade telephone channels with a QAM or a VSB system. If the 
sample values are coded into 8 bits plus sign, the chosen resolution will 
bring down the quantization noise to a negligible level of — G5 dB. The 
storage requirement is still only 256 bits, so a rather small bipolar 
ROM may be used. 

* Note that Q -t R need not be symmetric, but its eigenvalues are the same as those 
of the symmetric matrix in (19). 
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The resulting spectrum is shown in Fig. 2. Attenuation is 6 dB at the 
Nyquist frequency and 17.6 dB at the 6-percent edge. The sinc(-) 
weighting caused by the staircase output is not included; it would pro- 
duce additional attenuation at higher frequencies. The resulting eigen- 
value was \ m „ = 0.99963, showing that in fact the residual out-of-band 
energy is very small. 
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Fig. 2 — Spectrum of optimized impulse response with X = 0.99963. 
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V. CONCLUSIONS 



A new optimization method for sampled Nyquist-type impulse re- 
sponses has been proposed. Minimum energy in one frequency band as 
compared to the energy in any other frequency band is achieved. The 
computation is straightforward and involves the determination of 
eigenvectors of a symmetric matrix. It is shown how the constraint for 
zero intersymbol interference can easily be included. Applications of 
this method are numerous in digital signal synthesis and processing. 
Storage can be achieved with high accuracy using ROM's of moderate 
size. Any desired scaling of time and frequency response is possible with 
such a system and the well-known disadvantages of traditional filters, 
namely aging and tuning, are nonexistent. 
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